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(54) Apparatus and method of distributing call processing resources 



(57) A technique for allocating resources in a call 
processing system is disclosed whereby different levels 
of resources are allocated depending upon the available 
headroom in the system. The technique allows ad- 
vanced and better performing signal processing meth- 
ods to be used when the system is relatively idle, and 
acceptable but less robust algorithms to be used when 
system loading is heavy. 
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Description 

TECHNICAL FIELD 

This invention relates to telephony, and more spe- 
cifically, to a technique tor maximizing the efficiency of a 
Voice Processing System (VPS). 

DESCRIPTION OF THE PRIOR ART 

Voice Processing Systems have become prevalent 
over the last few years. Typically, such systems are im- 
plemented using a personal computer (PC) or other type 
of circuit card rack and a plurality of voice boards. The 
voice boards may include functions such as dual tone 
multi frequency (DTMF) detection, call progress moni- 
toring and analysis, text to speech (TTS) capability, echo 
cancellation, speech recognition, and a variety of other 
well known functions required and/or desired in such 
VPS systems. 

The voice boards are typically designed to handle 
more than one telephone line. Many commercially avail- 
able voice processing boards can handle four or more 
lines (i.e.; channels) simultaneously. These boards can 
be used to construct systems which can service dozens 
or even hundreds of incoming calls. Such multi-channel 
voice processing systems must be designed such that 
sufficient system resources (e.g.; CPU power, memory, 
etc.) are available to handle worst case loading. 

For example, a typical echo canceling filter in a VPS 
is implemented in software on a digital signal processor 
(DSP). Two important characteristics of the filter are the 
value of N, the tap length of the filter, and the particular 
filtering algorithm. 

As is well known in the field of digital signal process- 
ing, as N increases, the accuracy of the filter increases. 
However, increased N results in increased computation- 
al requirements which can noticeably burden, or even 
exceed, the limitations of the system. In general, the 
same rule usually holds true with respect to the complex- 
ity of the filtering algorithm: the more complex the algo- 
rithm, the better the results. Complex algorithms howev- 
er, can also burden the system beyond capacity. 

Considering the choice of N, in practical systems 
which utilize echo cancelling, N must be chosen small 
enough so that if all of the channels are active and re- 
quire echo cancellation, there still exists sufficient sys- 
tem resources to provide echo cancellation on afl chan- 
nels. This choice of N however, means that when only a 
relatively small number of channels are active (i.e.; the 
low activity state), the system is not providing the best 
echo cancellation that it could. Specifically, in the low ac- 
tivity state, all of the system resources are not fully uti- 
lized, since enough extra capacity must always be re- 
served to handle worst case performance. 

Those of ordinary skill in this field know how to pick 
N and the appropriate filtering algorithm such that in a 
worst case scenario, there are enough system resources 



to handle echo cancellation on all of the channels. Thus, 
in a four channel VPS for example, N will be chosen such 
that if all four channels are simultaneously in playback 
mode and therefore all require echo cancellation, there 
5 is enough memory, processing power, etc. to implement 
four N-tap echo cancelling filters. Relevant parameters 
for choosing N include CPU speed, desired processing 
speed, number of channels, etc., all of which are known 
in the art. 

io The problem with such systems is that there are two 
competing interests: Increased accuracy and perform- 
ance (achieved by increasing N) and required system 
computing power and resources (worsened by increas- 
ing N) . More particularly, while a relatively high N results 
in a better filter, use of a high N requires more system 
resources, faster processors, etc. 

Moreover, while echo cancelling is discussed as an 
example, other call processing features give rise to the 
same. issues. For example, in speech recognition, highly 
accurate algorithms require a large amount of process- 
ing power when compared with slightly less complex al- 
gorithms which are not as accurate. Therefore, it can be 
appreciated that there exists a need in the art for a tech- 
nique to achieve the quality and performance produced 
by relatively complex algorithms, without using the addi- 
tional resources required by such algorithms. Alterna- 
tively speaking, there exists no known method of balanc- 
ing the two competing interests. 



* The above and other problems of the prior art are 
overcome in accordance with the present invention 
which relates to a VPS which dynamically distributes 
35 system resources depending upon the load placed upon 
the system. In accordance with the present invention, the 
VPS includes a specified amount of resources, (e.g.; 
memory, CPU processing power, etc.), which may be as- 
signed to any one of many channels in a call processing 
40 application. These resources are assigned to a channel 
when an application processing a call on that channel 
requests a particular service provided by the resources. 

A special software module, the system manager, as- 
signs the resources to calls as needed, keeps track of 
45 resources surrendered by calls which no longer require 
such resources, and keeps track of the amount of mem- 
ory and computational power used by each resource. It 
is also aware of the total amount of memory and compu- 
tational power available to the entire system and there- 
to fore, the total amount of system headroom. 

As each new call comes in, it utilizes an unoccupied 
channel in the system. System resources are assigned 
to channels as they are requested. When a call is fin- 
ished using a resource, the resource is surrendered. 
55 If echo cancellation, for example, is requested for a 
channel, then the system manager will assign an echo 
canceling filter, the length of which is based on the re- 
maining headroom for the entire system. For example, if 
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a relatively large percentage of available resources are 
in use, then only a simple echo cancelling filter, which 
utilizes a relatively small amount of processing power 
and memory, will be assigned. The simple filter may be 
of relatively short length and would comprise a relatively 
straightforward digital signal processing algorithm. If 
however, a call requests an echo canceler and a rela- 
tively small percentage of system resources are active, 
then better echo canceliation can be achieved for this 
call by assigning a relatively large N filter to provide echo 
cancellation for this call. 

The system manager assures that when a call re- 
quests a particular resource type (e.g.; DTMF detection, 
echo cancellation, etc.), that resource is allocated. How- 
ever, the resource level allocated varies depending upon 
the amount of headroom. Headroom, in different embod- 
iments of the invention, may be measured as (i) the total 
number of system channels minus the number of active 
channels, (ii) the total number of system channels, minus 
the number of channels using a particular resource, (iii) 
the total amount of CPU power and/or memory, minus 
that being used presently or (iv) some other way includ- 
ing a combination of one or more of the above. However, 
headroom is some measure of the level of system activ- 
ity. 

By assigning resource levels based upon head- 
room, the system resources are dynamically allocated 
among the different telephone calls as needed. Thus, in 
echo cancellation, an efficient compromise is reached 
between highly complex filters, which improve perform- 
ance, and simpler filtering techniques which lower the 
required resources for the VPS and therefore prevent 
system capacity from being exceeded. 

While echo cancellation has been used for exempla- 
ry purposes,. it is understood that the scope of the inven- 
tion is broader. Specifically, the technique is applicable 
to any service which may be required by a call and which 
has different service levels. 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 depicts an exemplary flow chart for use in a 
Voice Processing System to implement the present 
invention; and 

FIG. 2 shows a table to be stored in memory and 
used to select different resource levels. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 



FIG. 1 depicts a block diagram indicating program 
flow and control for allocating and surrendering resourc- 
es required by various call processing applications. The 
arrangement of FIG. 1 includes a left branch 1 01 , intend- 
ed to perform all of the processing functions required for 
a call processing resource to be allocated to a particular 
call, and a right branch 1 02 which includes the functional 



blocks required to surrender resources when a call ends, 
or when such resources are no longer required by a par- 
ticular call. 

The actual software for implementing the flow chart 
5 of FIG. 1 may be written as a set of one or more modules 
termed herein a system manager. It is understood that 
the flow chart of FIG. 1 illustrates only the steps required 
to explain the present invention and that other conven- 
tional portions of the VPS are not shown. 
io We consider first a fully stable situation; i.e.; a plu- 
rality of calls are being processed by the VPS and all of 
the calls have previously been allocated all of the re- 
sources required for processing. No new calls are arriv- 
ing, and none of the calls being processed are requesting 
*s new resources or surrendering their resources. 

In such a case, the flow chart of FIG. 1 runs in a loop, 
which is entered at start 100. Decision block 103 checks 
to see if any resources have been surrendered, and 
since they have not, transfers control to decision block 
20 104. Decision block 104 checks to see if any existing 
calls have requested new resources, or if new calls re- 
quiring new resources have been received. If not, control 
is once again transferred back to decision block 1 03. 
Thus, in a stable situation, decision blocks 103 and 104 
25 simply alternatively check to see if new resources are 
required or if resources being used have been relin- 
quished. 

In order to further discuss left branch 101 , we now 
consider the case where a new resource is required. For 
30 example, a new call may arrive which requires a DTMF 
detector to be allocated for processing of this new call, 
or an existing call may request a text to speech converter, 
or playback mode may begin, thereby requiring echo 
cancellation for a channel. Many other examples of sit- 

35 uations where a new resource would be required will be 
apparent to those of ordinary skill in the art and with basic 
familiarity with call processing systems. 

When a resource is requested, decision block 104 
transfers control to operational block 1 05 which identifies 
the particular requestor, i.e.; the particular call and chan- 
nel requiring the resource. After the request is identified, 
control is transferred to operational block 1 06 which de- 
termines what type of resource is required. For example, 
operational block 106 may determine that an echo can- 

45 celer is required because the particular call in question 
is about to enter the playback mode. Other examples 
may be that a text to speech converter is required, or 
other such resource. 

After determining what type of resource is required, 

50 control is transferred to operational block 1 07 which de- 
termines what resource level is required. The resource 
level will vary depending upon the amount of headroom 
in the system. 

For example, consider a case where an echo can- 

55 celer is the resource type requested as determined by 
operational block 106. A large variety of echo cancelers 
may be available which vary in filter length, sophistica- 
tion of algorithm, memory requirements, etc. If there is a 



3 



5 EP 0 690 603 A2 6 



large amount of headroom in the system (e.g.; only three 
or four of 64 total lines are presently active), then rela- 
tively good echo cancellation can be achieved by select- 
ing a fairly complex echo cancellation algorithm with a 
relatively long filter length and which requires a relatively 
large amount of other system resources. The selection 
algorithm will be discussed in more detail later herein. 

On the other hand, if a large number of system re- 
sources are presently being used because nearly all of 
the channels are presently active, then a less sophisti- 
cated echo canceler will be used. The performance of 
such a less sophisticated echo canceler will be accept- 
able, although not as good as the performance of a more 
complex echo canceler which might be used if more 
headroom existed. 

After the resource level is selected, the appropriate 
resources are allocated by operational block 1 08 and the 
headroom is adjusted at operational block 109. Adjust- 
ment of the headroom indicates to the system manager 
that an additional line has been activated, that additional 
memory is now utilized because of the newly allocated 
echo canceler, that less processing power is available, 
etc. The technique of keeping track of headroom is not 
critical to the present invention but several examples will 
be described later herein. 

After adjusting the headroom, the system manager 
program returns to decisional block 103 to continue 
checking for surrendered resources and/or requested re- 
sources. The program enters right hand branch 102 
when a call no longer requires resources being used. 

Concerning the right hand branch 102, resources 
may be surrendered by particular call processing appli- 
cations. When a call processing application indicates 
that a resource is to be surrendered, decisional block 1 03 
receives an appropriate message and transfers control 
to block 110 which identifies which particular call 
processing application and/or telephone call is utilizing 
the resource to be surrendered. The resource type and 
level is then noted at blocks 1 1 1 and 112. 

Thus, after executing operational block 1 1 2, the sys- 
tem manager will know the particular additional memory, 
processing power, etc. which is now available for use by 
another call. These resources are then surrendered at 
block 113 and the headroom adjusted (increased) at 
block 114. Control is then transferred back to the loop 
comprised of decision block 103 and 104, which contin- 
ually looks for new resources to be allocated or allocated 
resources to be surrendered. 

The system manager is preprogrammed to know 
which resource levels are available for each resource 
type, as well as the memory, CPU power, etc. required 
by each resource type and level. Thus, the system man- 
ager can easily ascertain, when a resource is allocated 
or surrendered, how much to increase or decrease the 
headroom. 

Consider for example a first call arriving at the voice 
processing system. When the call is answered, a DTMF 
detector is allocated to that call. Upon allocating such 



DTMF detector, the system manager logs the amount of 
memory, processing power, etc. required by the DTMF 
detector and adjusts the headroom accordingly. Moreo- 
ver, the processing of this call in and of itself requires a 

5 certain amount of CPU power and thus the available 
CPU power is adjusted accordingly. As other resources 
are requested, the particular amount of headroom re- 
quired by each is deductedf rom the available headroom. 
One way of measuring available CPU power is to 

to first derive the maximum average number of instructions 
per time unit desired to be executed by the CPU without 
degrading performance. One can then calculate the av- 
erage number of instructions per time unit required to be 
executed by each of the different resources allocated 

is and deduct this amount from the total available number 
of instructions per second to be executed. An example 
using this technique is set forth later herein. A simpler 
way is to just use the number of channels active at a giv- 
en time. Other techniques wiil be apparent to those of 

20 ordinary skill of the art. 

We turn now to FIG. 2, which sets forth a simplified 
version of a table to be stored in memory for use by op- 
erational block 107 of FIG. 1 in order to determine the 
resource level to be allocated for a particular call request- 

2S ing such a resource. The table of FIG. 2 shows only two 
resource types: echo cancellation and voice recognition. 
It is understood that in an actual system many other such 
resource types would be present. 

Echo cancellation block 201 includes three resource 

30 levels; basic, intermediate and advanced, as indicated 
by blocks 202 - 204, respectively. Voice recognition block 

205 includes two resource levels, basic and advanced 

206 and 207, respectively. The variables M, C, M\ C\ 
MV and CV represent different amounts of memory and 

35 processing power. The appropriate values of these pa- 
rameters depend upon the particular algorithms chosen. 
Those of ordinary skill in this art are aware of how to 
choose the proper amount of memory and processing 
power required for a system. 

40 Consider a situation where a particular call requests 
echo cancellation resources. Blocks 202 and 208 indi- 
cate that if the available memory in the system is less 
than M and the number of inactive channels is less than 
the value C, then the basic echo cancellation algorithm 

45 will be used. The basic cancellation algorithm includes 
the smallest N of the three algorithms used for echo can- 
cellation. Thus, when there is only a small amount of 
memory available or when most of the channels are ac- 
tive in the system, the most basic algorithm, which pre- 

so sumably requires the least memory and processing pow- 
er of the three resource levels shown, is utilized. 

At block 203, it is indicated that an intermediate al- 
gorithm is utilized when there exists available memory 
of between M and M* and when the number of available 

55 channels is between C and C\ Finally, when the system 
is in a low activity state, block 204 shows that an ad- 
vanced algorithm will be utilized if, when the echo can- 
cellation resource is requested, the system has available 
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memory of greater than M' and a number of inactive 
channels greater than C\ 

The particular algorithms utilized as the basic, inter- 
mediate and advanced will not be discussed herein as 
numerous such algorithms are known in the area of dig- s 
ital signal processing. Moreover, the particular memory 
requirements and processing power for each of these al- 
gorithms can be readily calculated by the system design- 
er. Indeed, the parameters must be calculated in prior 
systems in order to ensure that worst case loading can io 
be handled. 

In the exemplary system described, both memory 
and number of channels are parameters utilized for de- 
termining which resource level should be allocated. 
Therefore both of these parameters must be within the is 
predefined limits in order for the particular resource level 
. to be allocated. For example, if the available memory is 
greater than 1ST and the number of inactive channels is 
greater than C\ then the system is in a low activity stale 
and an advanced echo cancellation algorithm will be uti- 20 
lized. 

If the available memory decreases to somewhere 
between M and M* then the intermediate algorithm needs 
to be used, even if the number of inactive channels is 
greater than C. Alternatively, if the number of available 25 
channels decreases to between C and C then the inter- 
mediate algorithm must be used even if available mem- 
ory is greater than M\ Such a system ensures that there 
is always enough memory and CPU processing power 
to effectively handle ail of the calls being processed. 30 
Thus, the system looks for the -best" algorithm that can 
be executed within the confines of available memory and 
processing power. 

Voice recognition block 205 may be carried out by a 
basic algorithm 206 or an advanced technique 207. As 35 
indicated at block 211, if the number of available chan- 
nels is less than or equal to a predetermined number CV, 
or available memory does not exceed a predetermined 
constant MV, then the basic algorithm is used since 
headroom in the system is relatively low. However, if the 40 
number of inactive channels is greater than CV, and 
available memory is greater than MV, an advanced al- 
gorithm is used which provides better results but requires 
more capacity. 

As previously explained, an alternative technique for 4S 
calculating the available processing power is to utilize 
the average number of instructions per time unit which 
is required by each particular resource. This parameter 
is available to system designers and may be a better in- 
dicator of true system loading than simply using the so 
number of active channels. 

CPU processing power may be measured as the to- 
tal available instruction cycles per second (e.g.; 100 mil- 
lion instructions persecond). Additionally, the system de- 
signer is aware of the average number of instructions per ss 
second required by an echo cancellation algorithm, a 
DTMF detector, or any other such resource. Moreover, 
the system designer is also aware of the memory re- 



quirements, for execution of each algorithm. Utilizing 
these parameters, the necessary values for design of the 
system can be calculated, as exemplified below. 

Consider two exemplary voice recognition algo- 
rithms, a basic algorithm which requires an average of 2 
million instructions per second to be executed, and an 
advanced algorithm which requires an average of 6 mil- 
lion instructions per second to be executed. Since the 
system can execute a total of 1 00 million instructions per 
second, allocation of the advanced algorithm requiring 6 
million instructions per second to be executed would pro- 
duce a total change in processing power of 6% while the 
basic algorithm would produce only a 2% change in 
processing power. Similar techniques may be applied to 
DTMF detection and other resources. 

By keeping track of all of the resources and the 
changes in headroom caused by each resource, the sys- 
tem manager can ascertain the percentage of the entire 
processing power utilized. A system designer may de- 
cide "that after seventy percent (70%), of the entire sys- 
tem is utilized (i.e.; the headroom falls below 30%), that 
a particular allocated resource should use a more basic 
algorithm rather than an advanced algorithm. Of course, 
memory requirements may be tracked via a similar tech- 
nique. 

It is understood that while the above describes the 
preferred embodiments of the invention, other variations 
and/or additions will be apparent to those of ordinary skill 
of this art. For example, the system can be arranged 
such that several resources are only allocated at one lev- 
el, while other resources may be allocated at varying lev- 
els depending upon headroom. Moreover, headroom 
may be measured by parameters other than processing 
power and memory, and the system manager may be 
implemented utilizing techniques other than that indicat- 
ed by the flow chart of FIG. 1 . It is also important to note 
that unlike prior systems, the resource level is deter- 
mined after it is decided that the resource is needed. 
Thus, resource levels can reflect system loading at the 
time the resource is needed. It is understood that all of 
these and other variations are intended to fall with the 
spirit and scope of the appended claims. 



Claims 

Claim 1 : A method of allocating resources to calls 
in a call processing system based upon system 
activity in the call processing system, the method 
comprising the steps of: 

determining a resource type to be allocated, 
determining the level of system activity in said 
voice processing system, and 

allocating, in response to said step of deter- 
mininc said level of system activity, to said call at a 
resource level depending upon said level of system 
activity. 
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Claim 2: The method of claim 1 wherein said step 
of determining comprises the step of measuring 
headroom. 

Claim 3: The method of claim 2 wherein headroom s 
comprises an amount of processing power available 
in said call processing system. 

Claim 4: The method according to claim 2 wherein 
headroom comprises an amount of memory availa- 10 
ble in said voice processing system. 

Claim 5: The method according to claim 2 wherein 
said headroom comprises an amount of memory 
and processing power available in said call process- fs 
ing system. 

Claim 6: The method according to claim 5 wherein 
said resource is an echo canceler, 

20 

Claim 7: The method according to claim 5 wherein 
said resource is a speech recognizer. 

Claim 8: The method according to claim 5 further 
comprising the step of updating the amount of avail- 25 
able headroom when a resource is allocated or a 
resource is surrendered. 

Claim 9: The method according to claim 8 wherein 
said step of updating comprises the steps of: 30 

ascertaining a number of operations per time 
unit required to implement a particular resource; and 

adjusting the amount, of processing power 
available, when said resource is allocated or surren- 
dered, by an amount based upon said number. 35 

Claim 10: Apparatus for allocating resources to a 
call in a call processing system, said apparatus com- 
prising: 

means for determining system activity; and *o 
means for allocating a resource at one of a plu- 
rality of resource levels, depending upon the amount 
of system activity. 

Claim 11: Apparatus of claim 10 wherein said 45 
means for determining comprises means for deter- 
mining headroom. 

Claim 12: Apparatus of claim 11 wherein said head- 
room comprises processing power. so 

Claim 13: Apparatus of claim 11 wherein said head- 
room comprises memory. 

Claim 1 4: Apparatus of claim 1 1 wherein said head- ss 
room comprises memory and processing power. 

Claim 15: Apparatus according to claim 14 wherein 



said resource is an echo canceler. 

Claim 16: Apparatus of claim 14 wherein said 
resource is a speech recognizer. 

Claim 17: Apparatus of claim 14 further comprising 
means for updating the amount of available head- 
room when a resource is allocated or surrendered. 

Claim 18: Apparatus of claim 17 wherein said 
means for updating comprises: 

means for ascertaining a number of operations 
per time unit required to implement said resource; 
and 

means for adjusting an amount of processing 
power available, when said resource is allocated or 
surrendered, by an amount based upon said number 
of operations per time unit. 

* 

Claim 19: Apparatus for performing a call process- 
ing function of a predetermined type, said apparatus 
comprising: 

means for performing said function at any one 
of a plurality of levels; and 

means for choosing a level at which said func- 
tion will be performed after determining to perform 
said function. 

Claim 20: Apparatus of claim 1 9 wherein said func- 
tion is echo cancellation. 

Claim 21: Apparatus of claim 19 wherein said 
means for choosing comprises means for examining 
system headroom. 

Claim 22: Apparatus of claim 1 9 wherein said head- 
room is comprised of memory and processing 
power. 
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